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1. Introduction 

Let Xi, X2, . . .,Xn be independent random variables and let T := T{Xi, . . . ,Xn) be a 
general sampling statistic. In many cases T can be written as a linear statistic plus an 
error term, say T = W -\- A, where 

n 

W = Y,9^{Xi), A:=A(Ai,...,A„)=T-VF 

and gi := gn,i are Borel measurable functions. Typical cases include U-statistics, multi- 
sample U-statistics, L-statistics and random sums. Assume that 

n 

E(5,(A,)) = forz = l,2,...,n and J2'^(9^{X^)) ^ I. (1.1) 

i=i 
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It is clear that if A — !■ in probability as n — > c», then we have the central limit theorem 

sup|P(r<z)-$(;z)|^0, (1.2) 

Z 

where $ denotes the standard normal distribution function, provided that the Lindeberg 
condition holds: 

71 

V£>0, Y.^gf{X,)I{\g,{X,)\>e)^0. 

1=1 

If in addition, ElAI^* < oo for some p > 0, then by the Chebyshev inequality, one can 
obtain the rate of convergence 

sup \P{T <z)~ $(z)| < sup \P{W <z)- $(z)| + 2(E|A|f )i/(i+P). (1.3) 

z z 

The first term on the right-hand side of (1.3) is well understood via the Bcrry-Esseen 
inequality. For example, using Stein's method, Chen and Shao [9] obtained 

snp\P{W <z)^<i>{z)\ 

Z 

Cn n \ 

J2EgUX,)I{\g.iX,)\ > 1) +Y,E\g,{X,)fl{\g,{X,)\ < 1) . (1.4) 
i=l i=l / 

However, the bound (E| A|'')^/(^"*"P^ is, in general, not sharp for many commonly used 
statistics. Many authors have worked toward obtaining better Bcrry-Esscen bounds. For 
example, sharp Berry-Essecn bounds have been obtained for general symmetric statistics 
by van Zwct [24] and Friedrich [12]. An Edgeworth expansion with remainder 0{n~^) 
for symmetric statistics was proved by Bentkus, Gotzc and van Zwct [3]. 

The main purpose of this paper is to establish uniform and non-uniform Bcrry-Esseen 
bounds for general nonlinear statistics. The bounds are the best possible for many known 
statistics. Our proof is based on a randomized concentration inequality approach to 
bounding P{W + A < z) — P{W < z). Because proofs of uniform and non-uniform bounds 
for sums of independent random variables can be proved via Stein's method (Chen and 
Shao [9]), which is much neater and simpler than the traditional Fourier analysis ap- 
proach, this paper provides a direct and unifying treatment toward the Berry-Esseen 
bounds for general nonlinear statistics. 

This paper is organized as follows. The main results are stated in next section, three 
applications arc presented in Section 3 and an example is given in Section 4 to show 
the sharpness of the main results. Proofs of the main results arc given in Section 5. For 
the proofs of other results, including Example 4.1, the reader is referred to our technical 
report (Chen and Shao [10]). 

Throughout this paper, C will denote an absolute constant whose value may change 
at each appearance. The Lp norm of a random variable X is denoted by H-'f ||p, that is, 
||X||p = (E|X|f)i/pforp>l. 



Normal approximation for nonlinear statistics 

2. Main results 



583 



Let {Xi, 1 < i < n}, T . W and A be defined as in Section 1. In the following theorems, 
we assume that (1.1) is satisfied. Put 

n n 

/3 = 5]E|5,(X.)p/(|g.(X,)|>l)+^E|g,(X,)|3/(|g,,(X0|<l) (2.1) 

1=1 1=1 

and let (5 > satisfy 

n 

^E|5,(X,)|min((5, |g,(X,)|) > 1/2. (2.2) 

Theorem 2.1. For eac/i 1 < « < fi, /ei he a random variable such that Xi and 
{Ai,W ^ gi{Xi)) are independent. Then 

n 

sup \P{T <z)- P{W < z)\ <A6 + E\WA\ + ^ E\g,{X,){A - A,)| (2.3) 
for S satisfying (2.2). In particular, we have 

n 

sup \P{T <z)- P{W < z)| < 2/3 + E|VFA| + ^ E|g,(X,)(A ~ A,)| (2.4) 

i=i 

and 

n 

sup \P{T <z)- $(z)| < 6.1/3 + E|VFA| + ^E|5,(X,)(A - A,)|. (2.5) 

The next theorem provides a non-uniform bound. 

Theorem 2.2. For eac/i 1 < « < let A^ &e a random variable such that Xi and 
{Ai,{Xj,j^i}) are independent. Then, for 5 satisfying (2.2) and for z £ , 

\P{T <z)- P{W <z)\ <7^+e~l^l/V, (2.6) 

where 

7. = P(| A| > (|z| + l)/3) + > {\z\ + l)/3) 

n 

+ Y,P{\W - g,{X,)\ > {\z\ - 2)/3)P(|5.(X,)| > 1), (2.7) 

i=l 
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n 

T ^ 22(5 + 8.5||A||2 + 3.6^ ||g,(X,)|l2|| A - A,||2. (2.8) 

i=l 

In particular, if l^\gi{Xi)\P < oo for 2 < p <3, then 

\P{T<z)~<^>{z)\ 

<P(|A|>(|z| + l)/3) 

(n n \ 

\\Ah + J2 Il.9.(^.)ll2|| A - A,||2 + ^E|g,(X,)r • (2.9) 
i=l i=l / 

A result similar to (2.5) was obtained by Friedrich [12] for gi = E(T|Xi) using the 
method of characteristic function. Our proof is direct and simpler, and the bounds are 
easier to calculate. The non-uniform bounds in (2.6) and (2.9) for general nonlinear 
statistics arc new. 

Remark 2.1. Assume E\g^{X^)\P < oo for p>2. Let 

^=( (^ 1)1-1 EE|g.(-^-)lj ■ (2-10) 

Then (2.2) is satisfied. This follows from the inequality 

min(a,6)>a-l^-3l^::^ (2.11) 

for a > and > 0. 

Remark 2.2. If /3 < 1/2, then (2.2) is satisfied with 5^(3/2. 
Remark 2.3. Let (5 > be such that 

n 

Y,^g^^{X^)I{\g^{X,)\>5)<\/2. 

i=l 

Then (2.2) holds. In particular, if Xi,X2, ■ ■ ■ ^Xn are independent and identically dis- 
tributed (i.i.d.) random variables and gi = then (2.2) is satisfied with 5 = co/^/n, 
where cq is a constant such that 'Ei{^/ngi{Xi))'^ I{\^/ngi{Xi)\ > co) < 1/2. 



Remark 2.4. In Theorems 2.1 and 2.2, the choice of A^ is flexible. For example, one can 
choose A, = A(Xi , . . . , 0, X,+i, . . . , X„) or A^ = A{Xi, . . . , , X^,Xi+l, . . . , X„), 
where {Xi, 1 < i < n} is an independent copy of {Xi, 1 <i <n}. The choice of gi is also 
flexible. It can be more general than .9^(2;) = E(T|A"i = x), which is commonly used in 
the literature. 
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Remark 2. 5. Let Xi,. . . , Xn be independent normally distributed random variables 
with mean zero and variance 1/n, and let T and A be as in Example 4.1. Then 



for <n< 16(l/e)''/^. This together with (4.5) shows that the boimd in (2.4) is 

achievable. Moreover, the term ^E|(7i(Xi)(A — Ai)| in (2.4) cannot be dropped. 

3. Applications 

Theorems 2.1 and 2.2 can be applied to a wide range of different statistics and provide 
the bounds of the best possible order in many instances. To illustrate the usefulness and 
the generality of these results, we give three applications in this section. The uniform 
bounds refine many existing results by specifying absolute constants, while the non- 
uniform bounds are new for many cases. Because the results are direct applications of 
Theorems 2.1 and 2.2, and the proofs are more or less routine verifications of assumptions, 
the proofs are omitted. Refer to Chen and Shao [10] for detailed proofs. One may also 
refer to Chen and Shao [10] for applications to random sums of independent random 
variables with non-random centering and to functions of nonlinear statistics. 

3.1. U-statistics 

Let Xi,X2t . ■ ^Xn be a sequence of i.i.d. random variables, and let /i(xi, . . . , a;,„) be a 
real-valued Borel measurable symmetric function of m variables, where m (2 < to < n) 
may depend on n. Consider the Hoeffding [17] U-statistic 



The U-statistic elegantly and usefully generalizes the notion of a sample mean. Numerous 
investigations on the limiting properties of the U-statistics have been done during the 
last few decades. A systematic presentation of the theory of U-statistics was given by 
Koroljuk and Borovskich [19]. We refer to the studies on uniform Berry-Esseen bounds 
for U-statistics by Filippova [11], Grams and Serfling [13], Bickel [4], Chan and Wierman 
[8], Callaert and Janssen [7], Serfling [21], van Zwet [24] and Friedrich [12]. One can 
also refer to the work of Wang, Jing and Zhao [26] on uniform Berry-Esseen bounds for 
studentized U-statistics. 

Applying Theorems 2.1 and 2.2 to the U-statistic yields the following result: 



E|WA|+^E|X,|3 + ^E|X,(A(Xi,...,X„...,X„)-A(Xi,...,0,...,X„))| 



i=l i=l 



(2.12) 
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Theorem 3.1. Assume that Eh{Xi, . . .,Xjn) = and = Eh'^{Xi, . . .,Xjn) < oo. Let 
g{x) ^J!!i{h{Xi, X2, . ■ . T Xm,)\Xi — x) and —Fig^{Xi) . Assume that ai > 0. Then 



sup 



^U^<z]-p(^j29iX.)<z] 
ma, J yV^'^itt J 



< 



(l + V2)(m-l)g 
(m(n — m + l))i/^cri 



(3.1) 



where Cq is a constant such that Eg^(Xi)/(|g(Xi)| > cqcti) < crf/2. If in addition 
E|g(Xi)|P<oo for2<p<S, then 



sup 

\m(7i 
and, for z E , 



-Un<Z 



.$(z) 



< 



(1 + \/2)(to-1)(j 6.1E|.g(Xi)|P 



(TO(n-m+l))i/2cri n(P-2)/2aP 



(3.2) 



P 



Un<z]- $(z) 



< 



9ma 



{l + \z\)'^{n-m+l)al 
C'E|g(Xi)|f 



13.5e-l^l/3mi/2cr 

(n -771+ 1)1/2(71 



Moreover, ifFi\h(Xi 



(l + |2|)Pn(P-2)/2(Tr 
.,X,n)\^ <oo for 2 <p < 3, then for z e , 



(3.3) 



-Un < Z 



.a>(z) 



\mai 

Cm'/^E\h{Xi,...,X^)\r 



< 



CE\giXi)\P 



{l + \z\)P{n-m + iy/^aP {1 + \z\)Pn(P-^')/^aP' 



(3.4) 



Note that the error in (3.1) is 0{n^^/^) only under the assumption of the finite second 
moment of h. The result appears to be previously unknown. The uniform bound given 
in (3.2) is not new, but the specifying constant for general m is new. The finite second 
moment of h is not the weakest assumption for the uniform bound. Friedrich [12] obtained 
an 0(71-1/2) ^^^^ E|/i|5/3 < 00. We refer the reader to Bentkus, Gotze and Zitikis [2] 
and Jing and Zhou [18] for discussions on the necessity of the moment condition. 

For the non-uniform bound, Zhao and Chen [27] proved that if m = 2, Fi\h{Xi, X2)\'^ < 
00, then 



mai 



Un<z]- <^>iz) 



< An-i/2(l + |2| 



-3 



(3.5) 



for z , where the constant A depends not on n and z, but on the moment of h. 
Clearly. (3.4) refines Zhao and Chen's result specifying the relationship of the constant 
A with the moment condition. After we finished proving Theorem 3.1, Wang [25] informed 
the second author that he also obtained (3.4) for m = 2 and p = 3. 

Theorems 2.1 and 2.2 can also be applied to derive uniform and non- uniform bounds for 
the non-i.i.d. case. Especially the uniform bound of Alberink [1] can be easily recovered. 
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Remark 3.1. Equation (3.3) implies that 



P 



( 



Un<z]~ < 



(3.6) 



(l + |z|)3(7i-m + l)i/2o-2 (l + |z|)Pn(P-2)/2crJ' 



for \z\ < ((?! — m + l)/my/^. For \z\ > {{n — m + l)/my/^, a bound like (3.6) can be 
easily obtained by using the Chebyshev inequality. On the other hand, if (3.6) holds for 
any z G R^, then it appears necessary to assume E|/i(Xi, . . . , Xm)|P < oo. 

Remark 3.2. Theorem 3.1 shows that the central limit theorem can still hold even when 
m = m(n) oo. However, the explicit Berry-Esseen bounds in (3.1) and (3.2) may not 
be optimal in terms of to. For the special case of elementary symmetric polynomials (i.e., 
h{xi,X2, ■ ■ ■ ,Xm) X1X2 ■ ■ -Xm ~ ^"^ , wherc /i = E(Xi) 7^ 0), discussed in van Es and 
Helmers [23], a/ai in (3.1) and (3.2) is of order r™, where r > 1, which is equivalent to 
requiring to < clogn for some c > so that the bound tends to 0, whereas in the result of 
van Es and Helmers [23], the bound tends to as long as to = 0(71^/^). The Berry-Esseen 
bound obtained by van Es and Helmers [23] gives an optimal dependence on m. 

3.2. Multisample U-statistics 

Consider k independent sequences {Xji,. . . , Xjnj } of i.i.d. random variables, j = 1, . . . , fc. 
Let h{xji, 1 = 1,..., mj,j = 1, . . . , fc) be a measurable function symmetric with respect to 
rUj arguments of the jth set, TOj > 1, j = 1, . . . , fc. Let 



where fi = {ni, . . . ,nk) and the summation is carried out over all 1 < iji < • • • < ijmj < rij, 
Uj > 2mj, j = 1, . . . ,k. Clearly, Un is an unbiased estimate of 9. The two-sample Wilcoxon 
statistic and the two-sample w^-statistic are two typical examples of multisample U- 
statistics. Without loss of generality, assume 9 = 0. For j = 1, . . . , fc, define 



9 = EhiXji,l = l,...,mj,j = l,...,k). 



The multisample U-statistic is defined as 




hj {x) — Fj{h{Xii, . . . , Ximi Xki , . . . , Xknik )\Xji = 



and let (t| = Fih'j{Xji) and 
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A uniform Berry-Esseen bound with 0((mini<j<fc Uj)"^/^) for the multisample U- 
statistics was obtained by Helmers and Janssen [15] and Borovskich [6] (see Koroljuk 
and Borovskich [19], pages 304-311). The next theorem refines their results. 

Theorem 3.2. Assume that 6 = 0, a"^ := Eh'^{Xii, . . . ,Xi„i-^; . . . ; Xki, ■ ■ ■ ,Xkmk) < 
and maxi<j<fc Cj > 0. Then for 2 < p<3, 



sup |P(a-t/, < .) _ $(.)[ < ii±^ E - + ^ E ^m,iX,,W (3.7) 
and for z E , 



C ' n^nh,{X,,)\^ 

3.3. L-statistics 

Let Xi, . . . ,Xn be i.i.d. random variables with a common distribution function F and let 
F„ be the empirical distribution function defined by 



Let J{t) be a real-valued function on [0, 1] and define 

/oo 
x.J{G{x))dG{x) 
-OO 

for non-decreasing measurable function G. Put 

rOO nOO 

I I J{F{s))J{F{t))F{mm{s,t))(l- F{nrAx{s,t)))dsdt 

and 

g{x)= I iI{x<s)-Fis))JiF{s))ds. 



— oo — oo 



The statistic T{Fn) is called an L-statistic (see Serfling [21], Chapter 8). Uniform Berry- 
Esseen bounds for the L-statistic that smooths J were given by Helmers [14] and Helmers, 
Janssen and Serfling [16]. Applying Theorems 2.1 and 2.2 yields the following uniform 
and non-uniform bounds for L-statistics. 
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Theorem 3.3. Let n > 4. Assume that EXj < oo and ^g{Xl)\P < oo for 2 < p < 3. If 

the weight function J{t) is Lipschitz of order 1 on [0, 1], that is, there exists a constant 
Co such that 

\J{t)^Jis)\<co\t-s\, forO<s,t<l, (3.9) 

then 

sumVT,.-HnK) - T(f )) < - < (ll^^M^k + ,3,0) 



\PiVria-\TiF,,)-T{F))<z)-^z)\ 

^ QclEX'i C ( ca\\X,h I E|.g(Xi)|?' \ 

- (l + |z|)2n<T2 ^ (l + |z|)P^ ?i(p-2)/2o-P y ■ ^ ' 

4. An example 

In this section we give an example to show that the bound of (2.4) in Theorem 2.1 is 
achievable. Moreover, the term ^E|(7i(Xi)(A — Aj)| in (2.4) cannot be dropped. The 
example also provides a counterexample to a result of Shorack [22] and of Bolthausen 
and Gotze [5]. We refer to Chen and Shao [10] for a detailed proof. 

Example ^.1. Let Xi,...,X„ be independent normally distributed random variables 
with mean zero and variance \/n. Define 

n 

W = ^X,, T ■.= T^ = W -e\W\-^/^ +eco and A = T -W = -e\W\-^^^ + eco, 

i=l 

where cq = E{\W\-^/^) ^ x'^/'^e-''^ dx. Let {X^,l<^<n} be an indepen- 

dent copy of {Xi, 1 < i < ri} and define 

1 " 

a = - ^ E| A(Xi, ...,X,,...,Xn)- A{Xi,. . . , X„ . . . , X„)|. (4.1) 

Then ET = and for < e < 1/64 and n > (l/e)"^, 

P(r<eco)-$(£co)>e2/V6, (4.2) 
E|l^A|+E|A| <7e, (4.3) 

n 

E|A|+^E|X,|3 + V^<Ce, (4.4) 
where C is an absolute constant. 
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Clearly, (4.2) implies that 

sup|F(r,<z)-$(z)|>^. (4.5) 
z 6 

A result from Shorack [22] (see Lemma 11.1.3, page 261) states that for any random 
variables W and A, 

sup \P{W + A < z) - $(z)| < sup \P{W <z)- $(0)1 + 4E|W^A| + 4E| A|. (4.6) 

z z 

Another result, which is in Theorem 2 of Bolthauscn and Gotze [5], states that if ET = 0, 
then 

sup \P{T <z)~^z)\<c(e\A\+J2 E|.9.(^0I' + , (4.7) 

where C is an absolute constant and a is defined in (4.1). 

In view of (4.3), (4.4) and (4.5), the results of Shorack and of Bolthauscn and Gotze 
can be shown to lead to a contradiction. 

5. Proofs of main theorems 



Proof of Theorem 2.1. Equation (2.5) follows from (2.4) and (1.4). When /?> 1/2, 
(2.4) is trivial. For (3 < 1/2, (2.4) is a consequence of (2.3) and Remark 2.2. Thus, we 
need only to prove (2.3). Note that 

- P{z -\A\<W <z)< P{T <z)- P{W <z)<P{z<W<z + |A|). (5.1) 

It suffices to show that 

n 

P{z<W<z + I A|) < 4(5 + E| W^A| + ^ ^g,{X,){^\ - A,)| (5.2) 

1=1 

and 

n 

p{z-\A\<w <z)<A5+^wA\+Y,^g,{x,){A-Ai)\, (5.3) 

i=l 

where 6 satisfies (2.2). Let 

r-|A|/2-<5, {oTw<z~5., 
f^{w) = lw-\{2z+\A\), ioY z-5<w<z+\A\+5, (5.4) 
[|A|/2 + (5, for w>2 + |A|+(5. 
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Let 

= 9^{Xi), M,{t) = <t<Q)-I{0<t< 

n 

M,{t) = EM,{t), M{t) = ^ i'h{t), M{t) = EAI{t). 

1=1 

Since and f^. (W — ^i) are independent for 1 <i <n and E^^i = 0, we have 

E{WfA{W)}= E ^{UfA{W)-fA{W-0)} 
l<i<n 

l<i<n 
■.= Hi+H2. 

Using the fact that M{t) > and /^(u;) > 0, we have 

^1= E E|e< / f'A{w+t)dt\ 

l<t<ri •'-i' ^ 

= E e( A(M^ + t)A/,(t)dA 

l<i<n J 

= E|y /i(W^ + t)A^f(t)dt| 
>E|^^^^^/i(W^ + i)M(i)di| 
>e|/(z<M/<z+|A|)^ M(i)di| 
= E E{/(z<W^<z+|A|)|e.|min(J,|C«l)} 

l<i<Ti 

1^1,1 =P(z<W^<z+|A|) E E?7», 



where 



Hi^2 — E 



E "n^-^m 



l<i<n 



Vi = I6|min(^, l^il). 
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By (2.2), 

E E?/'>l/2. 

l<i<n 

Hence 

i^ia > (l/2)P(z<M^<z + |A|). (5.7) 
By the Cauchy-Schwarz inequality, 

2\ 1/2 



/ \ 1/2 

< E E^'O ^'5. (5.8) 

As to H2, it is easy to see that 

\fA{w) - fA^{w)\ < ||A| - |A,||/2 < |A - A,|/2. 

Hence 

n 

|i/2|<(l/2)5]E|e.(A-A,;)|. (5.9) 
Combining (5.5), (5.7), (5.8) and (5.9) yields 

P{z<W<z + |A|) < 2|e|VF/a(W^)| + 5 + (1/2) f]E|e.(A - A,;)|| 

n 

< E|TyA| + 25E|W^| + 2(5 + ^ E|C,;(A - A,)| 

4=1 

n 

<45 + E|VFA|+^E|e.(A-A,)|. 

This proves (5.2). Similarly, one can prove (5.3) and hence Theorem 2.1. □ 

Proof of Theorem 2.2. First, we prove (2.9). For \z\ < 4, (2.9) holds by (2.5). For 

1 2; I > 4, consider two cases. 

Case 1: Yl^=i^\9i{^i)Y' > 1/2- By the Rosenthal [20] inequality, we have 

Pi\W\ > {\z\ - 2)/3) < Pi\W\ > \z\/6) < i\z\/6)-P^W\P 

{/ n \ P/2 n ^ 
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<C{\z\ + l)-'^Y.^\g,(^,)\P. (5.10) 

Hence 

|P(r <z)- $(z)| < P(|A| > (|z| + l)/3) + Pi\W\ > i\z\ - 2)/3) + P(|7V(0, 1)| > \z\) 

n 

< P{\A\ > {\z\ + l)/3) + C{\z\ + l)-Pj2E\g,{X,)\P, 

i=l 

which shows that (2.9) holds. 

Case 2: YJt=l^9^iX^)Y' < 1/2- Similar to (5.10), we have 

P{\W-9^{X,)\>{\z\-2)/i)<C{\z\ + l)-A{j2^g%X,)\ + f]E|.g,(X,)|4 



<c{\z\ + ir^ 

and hence 

n n 

7. < F(| A| > (|z| + l)/3) + ^((|z| + l)/3)-^E|g,(X,)r + ^ C{\z\ + l)-PE\g,{X,W 

n 

< P{\A\ > {\z\ + l)/3) + C{\z\ + l)-P5]E|5.(X,)r. 

4=1 

By Remark 2.1, we can choose 

\ l/(p-2) 



s = 



2ip-2)P- 
iP 



2(p-2)P-2 



Combining the above inequalities with (2.6) and the non-uniform Berry-Esseen bound 
for independent random variables yields (2.9). 

Next we prove (2.6). The main idea of the proof is first to truncate gi{Xi) and then 
adopt the proof of Theorem 2.1 to the truncated sum. Without loss of generality, assume 
z > 0, because we can simply apply the result to — T. By (5.1), it suffices to show that 

P(z-|A|<M^<z)<7^ + e-^/V (5.11) 

and 

P{z<W <z+\A\)<"f,+e~''^^T. (5.12) 
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Since the proof of (5.12) is similar to that of (5.11), we prove only (5.11). It is easy to 
sec that 

P{z - I A| < 1^ < z) < P(| A| > (z + l)/3) + P{z - I A| < < z, | A| < (z + l)/3). 

Now (5.11) follows directly by Lemmas 5.1 and 5.2 below. This completes the proof of 
Theorem 2.2. □ 

Lemma 5.1. Let 

n 
i=l 

Then 

P{z - |A| < < z, |A| < (z + l)/3) 
< P{z - |A| < < z, I A| < (z + l)/3) 

71 n 

+ E > (^ + l)/3) +J2p{W-^.>{z- 2)/3)P(|e.| > 1). (5.13) 

Proof. We have 

P{z -\A\<W<z, |A| < (z + l)/3) 

<P(z-|A|<M/'<z,|A|<(z + l)/3, max \£,^\<l 

\ l<i<n 



+ P{ z-\A\ < W^<z,|A| < (z + l)/3, max \^,\ > 1 

71 

< P{z - I A| < < z, I A| < (z + l)/3) + E > (2z - l)/3, > 1) 



and 



i=l 



Y,P{W>{2z-l)/3,\^,\>l) 

1 

n n 

< E > + + E > - < (^ + l)/3, ICd > 1) 

1^1 i=l 
71 n 

< E > + + E - ^» > - 2)/3, le.l > 1) 

i^l i=l 
71 n 

= E ^(6 > (^ + l)/3) + Y.P{W-^,>{z- 2)/3)P(|e, I > 1), 
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Lemma 5.2. We have 

P{z - |A| < < z, |A| < (z + l)/3) < e^^/^r. (5.14) 

Proof. Noting that E^, < 0, that <l + s + s'^{c'' - 1 — a)a for s <a and a > and 
that a^i < a, we have for a > 0, 



Ee"^ = JlEe-^^' 

i=l 
n 

<n(l+«Ee, + (c'^-l-a)Ee7) 
<exp((e''-l-a)f^Ee7 



<cxp (c'^-l-a)5;]Ee,^ 



\ i=l / 

:exp(e°-l-a). (5.15) 



In particular, we have Ee^/^ < exp(ei/2 - 1.5). If (5 > 0.07, then 
P{z - |A| < < z, |A| < (z + l)/3) 

< P{W > (2z - l)/3) < e-^/3+i/6Ee^/2 

< e-^/3 exp(c°-^ - 4/3) < 1.380^"/=^ < 20<5c^^/^ 

This proves (5.14) when 6 > 0.07. 
For 6 < 0.07, let 

C 0, for w < z - |A| - S, 

/a(u;) = < e"'/2(«;- z + |A| +(5), for z - |A| - (5 < w < z + 5, (5.16) 
[e"'/2(|A| +2J), ioTw>z + d. 

Put 

M,(t) = < t < 0) - 7(0 < t < -f.)}, Ai(0 = M^{t). 

By (5.5) and similar to (5.6), we have 

E{WfA{W)} = Ejy f^{W + t)M{t)dt'^ 
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n 

— G1+G2. (5.17) 

It follows from the fact that M{t) > 0, f'^{w) > c"'/^ for z - |A| - 5 < w < z + (5 and 
f'^iw) > for aU w that 

Gi > fkiW + t)M{t) dtj 

> ^\e^^-^^'^I{z ~\^\<W<z, I A| <{z + l)/3) ^ _ dtj 
= E{e('^-'^)/2/(z - |A| < 1^ < z, |A| < (z + l)/3)} / EA/(0 di 

J|t|<5 

+ E|e(^-*'/2/(z - |A| < < z, | A| < (z + l)/3) ^ (A7(t) - EA7(t)) dij 
>Gia-Gi,2, (5.18) 

where 

Gi,i = e^/3-i/6-o.o35p(^ - |A| < < z, |A| < (z + l)/3) / EA/(t) dt, 

J|tl<(5 

Gi,2 =e|^ e'^/2|A/(t)-EM(t)|dt|. 
By (2.2) and the assumption that 5 < 0.07, 

n 

EAf(t)dt== VE|e.|min((5,|e*|) 
l*l<^ ,=1 

n 

= 5]E|C.|min(<5,|6l)>l/2. 

i=l 

Hence 

Gi,i > (l/2)e"/3-i/6-o.o35p(^ - |A| < < z, |A| < (z + l)/3). (5.19) 

By (5.15), we have Ee^ < exp(c — 2) < 2.06. It follows from the Cauchy-Schwarz in- 
equality that 



Gi,2 < 0.5 / (0.5Ee^ + 2E\M{t) - EM(t)p) dt 
J\t\<s 
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< 0.5 i 2.06(5 + 2 V / EC2(j(_^^<^<o) + /(0<i<-^0)d4 

I l^iJ\t\<s J 

= 0.5 1 2.06(5 + 2 ^ E^f min((5, If, | ) | 

< 0.5|2.065 + 2(5^E42| < 2.03(5. (5.20) 

With regard to G2 , it is easy to sec that 

I/aH - /a.HI < e"'/2||A| _ |A,|| < e-/^\A - A,|. 

Hence, by the Holder incquaUty, (5.15) and the assumption that and W — are 
independent, 

n 

|G2|<5:E|e,c(^-«')/2(A_A^)| 

<^(EC^^-«')'/'(E(A-A,)^)'/' 

n 

= ^(E^fEe^-«0^/^i|A-Aj2 

n 

<1.44^i|e,!|2||A-A,||2. (5.21) 

i=l 

Following the proof of (5.15) and by using |e'* — 1| < |s|(e" — l)/a for s <a and a > 0, we 
have 

n 

EWh"^ = ^ E42e«'Ee^-«' + ^ Ee.(e«- - l)EC,(e«^ - l)Ee^-«'-«^ 

i=l ^^'iy^j^n 



<2.06e5;]E42 + 2.06(e-l)2 ^ EefE^f 



t2 

i—1 l^i^T^i^;*^ 



< 2.06e + 2.06(e - 1)^ < 3.42^. 
Thus, we obtain 

E{W/a(W-)} < ^W\c^/'^{\A\ + 26) 

<{||Al|2 + 2(5}(E(iy2gW))i/2 

< 3.42(11 AII2 + 2(5). (5.22) 
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Combining (5.17), (5.19), (5.20), (5.21) and (5.22) yields 

P{z - |A| < < z, |A| < (z + l)/3) 

< 2e-^/3+i/^+°-°3^|3.42(|| A||2 + 25) + 2.035 + 1-44^ U^h || A - AJaj 
<e-^/3|22J + 8.5||A||2 + 3.6f]||6||2||A-A,||2| 

This proves (5.14). □ 
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